PyRS: Cross-platform Data Fault-tolerant Storage Library Based on RS Erasure Code

نویسندگان

چکیده

<p>Erasure code has been used by more and researchers to solve the problem of efficient, reliable, fault-tolerant data storage. However, existing libraries based on erase can only run Linux platform, some them need GPU support. This paper implements a cross-platform storage library RS erasure code, PyRS, which is running CPU without support developed in Python. PyRS uses Vandermonde matrix as coding Numba NumPy speed up optimize program. compares with Jerasure same platform. The results show that encoding decoding 8 times faster than Jerasure. usage rate both about 25% memory 5% higher experiments are carried out Windows Experimental compared platform almost decoding, its increases 15%, while decreases 5%.</p> <p> </p>

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Performance evaluation of the Mojette erasure code for fault-tolerant distributed hot data storage

Packet erasure codes are today a real alternative to replication in fault tolerant distributed storage systems. In this paper, we propose the Mojette erasure code based on the Mojette transform, a formerly tomographic tool. The performance of coding and decoding are compared to the Reed-Solomon code implementations of the two open-source reference libraries namely ISA-L and Jerasure 2.0. Result...

متن کامل

Platform-Based AS/RS for Container Storage

Abslracf-The ever-increasing demand on container porl throughput has mounted the necessity of a more efficient container storage StNCtUE, the Equirements of which apparently can be met by ASKS because of its abilities of fully automating material handling and the potentials for delivering high performance. In this study, we present an ASKS for container storage, develop the travel time models f...

متن کامل

Byzantine-tolerant erasure-coded storage

This paper describes a decentralized consistency protocol for survivable storage that exploits data versioning within storage-nodes. Versioning enables the protocol to efficiently provide linearizability and wait-freedom of read and write operations to erasure-coded data in asynchronous environments with Byzantine failures of clients and servers. Exploiting versioning storage-nodes, the protoco...

متن کامل

A Non-MDS Erasure Code Scheme for Storage Applications

This paper investigates the use of redundancy and self repairing against node failures indistributed storage systems using a novel non-MDS erasure code. In replication method, accessto one replication node is adequate to reconstruct a lost node, while in MDS erasure codedsystems which are optimal in terms of redundancy-reliability tradeoff, a single node failure isrepaired after recovering the ...

متن کامل

On fault-tolerant data placement in storage networks

Acknowledgments First of all, I would like to thank my advisor Prof. Dr. Friedhelm Meyer auf der Heide for his great support. Friedhelm always left me the freedom to address the problems I was interested to investigate and which have now become the core of this thesis. Moreover, basing on his early results in PRAM simulation and resource management in networks, I had several motivating discussi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Internet Technology

سال: 2022

ISSN: ['1607-9264', '2079-4029']

DOI: https://doi.org/10.53106/160792642022122307014